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Section  1 


INTRODUCTION  AND  SUMMARY 


1.1  INTRODUCTORY  REMARKS 

This  document  describes  research  carried  out  by  ALPHATECH,  Inc. 
for  the  Air  Force  Office  of  Scientific  Research  under  contract 
F49620-81-C-0015 .  We  describe  a  study  into  the  problem  of  detection 
using  geographically  distributed  sensors  and  limited  communication. 

This  research  lead  to  a  deeper  understanding  of  this  problem  and  to  the 
development  of  good  suboptimal  distributed  detection  algorithms. 

In  this  section  we  summarize  the  work  on  this  project  to  date. 

This  is  done  by  briefly  outlining  the  contents  of  three  interim  reports 
(included  as  appendices). 

1.2  DECENTRALIZED  DETECTION  GIVEN  WAVEFORM  OBSERVATIONS 

In  this  interim  report  (Appendix  A)  we  formulated  a  decentralized 
detection  problem  in  which  the  observations  at  each  sensor  are  known 
waveforms  corrupted  by  Gaussian  noise  processes  (assumed  independent 
between  sensors) .  In  this  problem  formulation  an  agent  associated  with 
each  sensor  must  make  a  decision  based  only  on  the  observations  avail¬ 
able  from  that  sensor.  These  decisions  are  then  either  used  as  the 
basis  for  some  local  action  or  are  transmitted  to  a  fusion  center  where 
they  are  combined  to  form  a  global  estimate.  In  either  case  a  cost  is 
associated  with  each  combination  of  true  and  false  decisions  and  the 
problem  is  then  to  determine  the  optimal  decision  law  for  each  agent. 

Because  we  assume  that  the  signal  being  observed  is  known  and  that 
the  noise  is  uncorrelated  between  agents  we  can  determine  the  optimal 


decision  laws.  By  using  a  Karhunen-Loeve  expansion  we  can  reduce  thi 
problem  to  a  sequence  of  problems  involving  a  finite  number  of  obser¬ 
vations  each  of  which  can  be  solved  using  the  techniques  of  Tenney  and 
Sandell  [1].  The  solutions  of  these  problems  form  a  sequence,  the 
limit  of  which  is  the  solution  to  the  waveform  observation  problem. 

Two  cases  are  considered  in  this  interim  report.  The  first  is 
that  of  detection  when  the  noise  is  white  and  the  second  is  that  of 
detection  when  the  noise  may  be  any  Gaussian  process  with  known  mean 
and  covariance.  In  both  cases  the  solution  takes  the  following  form. 
Each  agent  forms  a  likelihood  ratio  based  on  his  own  observations. 

This  statistic  is  then  compared  to  a  threshold  and  a  decision  is  made 
based  on  whether  the  statistic  is  above  or  below  the  threshold.  The 
thresholds  are  determined  so  as  to  minimize  the  global  cost  (i.e.  the 
agents'  separate  thresholds  are  optimized  jointly). 

Examples  are  given  illustrating  both  the  case  in  which  local  de¬ 
cisions  are  combined  in  a  fusion  center  and  in  which  they  are  penalized 
directly  by  the  global  cost  function. 

1.3  DISTRIBUTED  DETECTION  OF  KNOWN  SIGNALS  IN  CORRELATED  NOISE 

In  this  interim  report  (Appendix  B)  we  investigated  the  effect  on 
the  distributed  detection  problem  of  noise  which  is  correlated  between 
agents.  The  solution  to  this  problem  is  shown  to  require  solving 
difficult  coupled  functional  equations.  Since  these  equations  are  not 
analytically  tractable  and  since  they  are  not  amenable  to  numerical 
solution  techniques,  we  consider  a  suboptimal  detection  policy  termed 
the  decentralized  likelihood  ratio  test  (DLRT). 

The  DLRT  is  motivated  by  the  optimal  results  for  the  uncorrelated 


noise  case.  Each  agent  forms  a  likelihood  ratio  test  and  compares  it 
to  a  threshold  to  determine  that  agent's  decision.  The  thresholds  are 
those  which  minimize  the  expected  value  of  the  global  cost. 

We  explore  the  behavior  of  this  suboptimal  law  by  considering  a 
variety  of  numerical  problems.  We  find  that,  in  general,  the  perfor¬ 
mance  degrades  as  the  correlation  increases.  This  is  in  complete  con¬ 
tradistinction  to  the  centralized  case  where  performance  as  a  function 
of  correlation  is  highly  problem  dependent. 

This  leads  us  to  explore  whether  the  DLRT  is  a  poor  suboptimal 
estimator  or  whether  its  performance  is  indicative  of  that  which  could 
be  expected  from  an  optimal  distributed  detection  algorithm.  For  the 
case  in  which  the  signals  received  by  each  sensor  vary  only  in  magni¬ 
tude  we  can  show  that  a  sufficient  statistic  for  optimal  detection  is 
in  fact  the  local  likelihood  ratio.  The  optimal  decision  law  must  then 
be  some  binary  function  of  this  statistic.  Binary  functions  can  be 
parameterized  by  the  "thresholds"  dividing  the  different  regions  (DLRT 
corresponds  to  the  special  case  of  one  threshold  per  sensor) .  A 
variety  of  numerical  examples  were  studied:  in  all  the  DLRT  was 
optimal.  This  seems  to  indicate  that  the  DLRT  is  a  good  suboptimal  de¬ 
tection  law  and  that  its  performance  with  respect  to  centralized  laws 
reflects  the  constraint  of  decentralization  rather  than  severe  sub¬ 
optimality  . 

1.4  DISTRIBUTED  DETECTION  OF  AN  UNKNOWN  SIGNAL  IN  NOISE 

In  this  interim  report  (Appendix  C)  we  consider  the  problem  of 
distributed  detection  when  the  noise  between  agents  is  uncorrelated 
but  in  which  the  signal  is  assumed  to  be  a  Gaussian  random  process  of 


known  mean  and  covariance.  As  in  the  problem  considered  in  Section 
1.3,  the  optimal  detection  laws  must  be  found  by  solving  coupled 
functional  equations.  As  we  cannot  solve  these  equations  we  again  con¬ 
sider  the  performance  of  DLRT  algorithms. 

This  problem  is  more  difficult  than  that  considered  earlier  as  the 
likelihood  ratio  is  a  nonlinear  function  of  the  observations.  This 
means  that  the  statistics  computed  are  not  Gaussian  and  thus  the 
optimal  thresholds  and  the  corresponding  performance  are  very  difficult 
to  determine  exactly. 

However,  for  the  case  in  which  the  observation  time  is  long  in 
comparison  to  the  dynamics  of  the  signal  process,  the  likelihood  ratio 
is  nearly  Gaussian.  We  therefore  determine  the  first  and  second 
moments  of  the  likelihood  ratio  and  compute  the  thresholds  as  if  this 
statistic  were  Gaussian.  Several  numerical  examples  provide  insight 
into  the  performance  of  the  DLRT  law  for  this  problem. 

Unfortunately,  the  Gaussian  approximation  used  above  is  not  valid 
in  the  "tails"  of  the  distribution  and  thus  cannot  be  used  to  determine 
low  probability  of  false  alarm  detection  laws.  Approximations  based  on 
Chernov  bounds  ([2]  and  [3])  have  been  developed  which  are  quite 
accurate  and  will  be  reported  on  subsequently. 

1 . 5  SUMMARY 

In  this  project  we  have  characterized  the  performance  of  distri¬ 
buted  detection  algorithms  based  on  the  DLRT  algorithm.  While  this 
algorithm  was  selected  on  an  ad  hoc  basis  and  is  thus  suboptimal  a 

priori,  evidence  indicates  that  it  may  be  optimal  in  certain  cases,  and 
thus  we  expect  the  insights  obtained  are  indicative  of  the  requirement 
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of  decent  r;i  1  iz.it  ‘oil  and  not  tli.it  of  local  like!  iliood  ratio  tests. 

Wo  have  examined  the  behavior  of  the  1)1. KT  on  a  wide  variety  of 
cases :  known  and  unknown  signal,  correlated  and  uncorrelated  noise, 

decentralized  and  hierarchical  decision  laws,  etc.  In  each  of  these 
cases  we  have  deepened  the  understanding  of  how  well  distributed  de¬ 
tection  laws  can  perform. 
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ABSTRACT 

In  this  taper  we  solve  a  decentralized  hypothesis  testing  problem  in  which 
the  observations  are  waveforms  corrupted  by  Gaussian  noise  processes.  This 
paper  extends  the  results  of  Tenney  and  Sandell  [1]  which  allowed  only  dis¬ 
crete  observations. 

1.  INTRODUCTION 

In  this  paper  we  extend  the  distributed  detection  results  derived  by 
Tenney  and  Sandell  [1]  for  discrete  observations  to  the  case  of  continuous 
waveform  observations.  This  extension  is  accomplished  (as  in  the  classical 
centralized  case)  by  the  use  of  a  Karhunen-Loeve  expansion  [2]  of  the  received 
waveform.  The  cases  we  consider  are  those  in  which  a  collection  of  distributed 
agents  observes  known  deterministic  signals  corrupted  by  Gaussian  white  noise 
either  with  or  without  a  Gaussian-colored  noise  component.  For  these  cases  we 


can  explicitly  compute  the  statistics;  of  the  likelihood  functions,  thus 


reducing  the  waveform  observation  case  to  that  of  a  scalar  observation.  The 
outline  of  this  paper  is  the  following. 

In  Section  2  we  briefly  describe  the  types  of  situations  which  give  rise 
to  distributed  detection  problems.  In  Section  3  we  briefly  review  the  results 
of  Tenney  and  Sandell  [1] ,  and  in  Section  4  we  extend  these  results  to  the  case 
of  waveform  observations  in  white  Gaussian  noise.  In  Section  5  we  modify  this 
extension  to  account  for  observations  corrupted  by  a  combination  of  white  and 
colored  Gaussian  noise.  Finally,  in  Section  6  we  discuss  various  extensions 
of  these  results  that  we  are  currently  investigating. 


2.  MOTIVATION 

Consider  a  situation  in  which  geographically  distributed  sensors  observe 
a  common  region  for  the  purpose  of  determining  the  presence  or  absence  of  a 
certain  phenomenon.*  Because  of  such  considerations  as  cost,  reliability, 
survivability,  communications  bandwidth,  etc.,  we  assume  that  the  observations 
of  the  various  sensors  cannot  be  transmitted  to  a  common  node  for  centralized 
processing.  Rather,  a  local  decision  must  be  made  at  each  sensor  which  can 
then  either  be  transmitted  to  some  common  node  or  be  used  as  the  basis  for 
some  local  action. 

If  the  local  decisions  are  transmitted  to  a  central  node  then  we  assume 
that  they  are  combined  to  form  a  "global”  decision  by  some  prespecified  deci¬ 
sion  function  f  (e.g.,  voting).  Further,  we  assume  that  costs  can  be  asso¬ 
ciated  with  the  various  combinations  of  truth  and  global  decision  (corresponding 


Think  of  multistatic  radar  for  a  concrete  example. 
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to  false  alarms,  missed  detections,  etc.).  This  loads  to  the  situation  de¬ 
picted  in  Fig.  2-1  in  which  two  agents  associated  with  distributed  sensors  make 
local  decisions  Uj  and  u2-  These  decisions  are  combined  to  produce  a  global 
decision 

u  =  f(ul(u2)  .  (2-1) 

Note  that  the  global  cost  J'(u,H)  can  be  rewritten  so  as  to  depend  only  on  the 
local  decisions  by  defining 

J(u1,u2,H)  =  J*  (f (ulfu  ),H)  .  (2-2) 

If  the  local  decisions  are  not  transmitted  to  a  central  node  but  rather 
are  used  as  the  basis  of  local  actions  then  we  assume  that  a  cost  can  be  asso¬ 
ciated  with  each  combination  of  truth  and  local  decisions  (e.g.,  one  agent 
detects  a  target  and  another  does  not).  This  situation  is  illustrated  in 
Fig.  2-2  and  might  arise,  for  example,  if  weapons  are  colocated  with  distributed 
sensors  and  are  to  be  used  based  on  local  sensor  decisions.  One  could  then 
associate  costs  with  having  several  agents  detect  and  fire  on  a  single  target, 
having  only  one  agent  detect  and  fire  on  a  target,  etc. 

For  our  purposes  the  key  observation  is  to  note  that  in  both  cases 
(hierarchical  and  distributed  decisionmaking)  the  cost  can  be  written  as  a 
function  of  the  local  decisions.  Thus  we  can  consider  both  of  these  cases  by 
formulating  a  problem  in  which  agents  interact  only  through  a  common  cost 
function  J(Uj,u2,H). 
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PHENOMENON  H 


AGENT  n 


LOCAL 

decision  n 


J * (u, H)  global  decision  cost 


Figure  2-1.  Hierarchical  Decisionmaking. 


AGENT  H2 


LOCAL 

decision  n 


J(uj,u2,H) 


Figure  2-2.  Distributed  Decisionmaking. 


3.  REVIEW 


In  [1]  Tenney  and  Sandell  solved  the  following  problem.  Assume  that  two 
hypotheses,  and  H1,  are  possible  and  occur  with  a  priori  probabilities 

p(H°)  =  pO  p(H1)  =  p1  .  (3-1) 

For  each  hypothesis  the  sensor  observations  y^  (which  may  be  random  vectors) 
have  known  probability  distributions 

p(y1.y2|H1)  =  p(yj |H1)p(y2 Ih1)  ,  i=o,i  .  (3-2) 

Note  that  we  assume  the  observations  and  y2  are  statistically  independent 
when  conditioned  on  the  hypotheses.  Only  decision  rules  of  the  form 

|  0,  H®  is  declared  to  have  been  detected 

Ui  =  )  ' 

(1,  H1  is  declared  to  have  been  detected 

where  u^  is  a  function  only  of  y^,  are  allowed.  The  decision  rule  can  be 
defined  by  the  conditional  probability  distribution  function 

p (u . =0  I y . )  (3-3) 

l  1  l 


which  defines  a  randomized  decision  rule.  The  objective  is  to  choose  the 
(randomized)  decision  rules  so  as  to  minimize  the  expected  cost,  i.e., 


min  E [ J (Uj , u2 , H) ] 


(3-4) 
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For  this  problem  formulation  Tenney  and  Sandell  proved  that  the  optimum 
decision  rules  are  deterministic  and  are  given  by* 


lr(yj)  £ 


(3-5) 


ir(y2)  %  t2 


(3-6) 


where 


p(y . iH°)p° 


£r(yi}  =  — rr~r 

p(yi|n  )p 


(3-7) 


The  thresholds  tj  and  t2  satisfy  the  following  equations. 


AJj+AJ,  f  P(y2|H})dy2 


= 


'{y2|str(y2)>t2} 


/,  0 

p(y2|H  )dy2 


{y2 1  fi-r  (y2)>t2) 


(3-8) 


AJ5+AJ2  1  f  pfyjn^dyj 


= 


'{yj ) Ar(y1)>t1} 


aj6+aj4  i  J  P(y1|H°)dy1 


{y x |Ar(y1)>tj} 


(3-9) 


where 


AJ  =  J(0,1,H1)  -  Jfl.l.H1) 


(3-10a) 


The  notation  f(x)j<®y  indicates  choose  u=0  if  f(x)>y,  u-1  if  f(x)<y/  and  make 
either  choice  if  f(x)=y. 
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(3 -10b) 


r 


AJ 


2 


AJ4 


J(0,0,H1)  +  J (1, 1, H1 )  -  J (1 ,0,H* )  -  J (0 , 1 , ) 
AJ3  =  J  (1 , 1 ,  H°)  -  J  ( 0 , 1 ,  H  0 ) 

J (1 , 0, H°)  +  J (0, 1 , H°)  -  J(0,0,H°)  -  J (1 , 1 , H°) 
AJ5  =  JfbO.H1)  -  J  (1 ,1,  H1 ) 


{3-1 Oc) 

(3-1 Od) 

( 3-10e) 


and 


AJ.  =  J(1,1,H°)  -  J (1 , 0, H 0 )  .  ( 3-1  Of ) 

b 

Equations  3-8  and  3-9  define  agent-by-agent  optimal  decision  strategies  (i.e., 
ones  which  cannot  be  improved  by  the  unilateral  action  of  an  agent).  If  more 
than  one  solution  to  these  equations  exists  then  the  costs  corresponding  to 
these  solutions  must  be  compared  to  determine  the  globally  optimal  strategy. 


4.  WAVEFORM  OBSERVATIONS  IN  WHITE  NOISE 


In  this  section  we  consider  the  problem  posed  in  Section  3  modified  so 
that  the  observations  are  waveforms  rather  than  vectors.  The  solution  of  the 
previous  section  is  not  directly  applicable  since  ptyjlH1)  need  no  longer  be 
well  defined  thus  invalidating  Eqs.  3-6  through  3-9.  The  approach  we  take  to 
extending  the  results  of  [1]  to  the  waveform  case  requires  that  we  assume  the 
received  waveforms  are  Gaussian  processes.  In  this  section  we  assume  the 
received  waveform  is  either  white  noise  or  a  known  deterministic  signal  plus 
white  noise;  in  the  next  section  we  allow  the  noise  waveforms  to  be  arbitrary 
Gaussian  processes. 
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The  problem  formulation  is  as  given  in  Section  3  except  that  instead  of 
specifying  the  conditional  probability  distributions  of  Eqs.  3-2  we  define  the 
observations  under  the  two  hypotheses  by 

H1:  y^t)  =  ^e7  si(t)  +  n^  (t)  0  <  t  <_T  (4-la) 

H° :  yi(t)  =  ni(t)  0  <_  t  <_  T  .  (4-lb) 

The  n^(t)  are  zero-mean  Gaussian  white  noise  processes  with  spectral  height 
tsh(t)  and  we  assume  n1  (t)  and  n2<t)  are  statistically  independent.  Further¬ 
more,  without  loss  of  generality,  we  assume 

T 

f  s?(t)dt  =  1  .  (4-2) 

0 

The  approach  we  take  to  solving  this  distributed  detection  problem  is  to 
represent  the  received  waveforms  as  a  countably  infinite  sequence  of  coeffi¬ 
cients.  Any  truncation  of  this  sequence  produces  a  problem  that  is  readily 
solved  by  the  techniques  of  Section  3.  We  solve  the  waveform  problem  by  showing 
that  the  limiting  solution  obtained  by  considering  more  and  more  coefficients 
is  well  defined  and  solves  the  waveform  problem. 

The  received  waveforms  can  be  expressed  as* 

K  k  k 

y .  (t)  =  l.i.m.  L  y<f>.(t)  ;  0  <_  t  <_  T  (4-3) 

1  k=l  1  1 


An  arbitrary  orthonormal  set  is  allowed  here  because  we  Irave  assumed  that  the 
observation  noise  is  white. 
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where  l.i.m.  is  interpreted  as  limit  in  the  mean  and  Eq.  4-3  is  equivalent  to 


lira  E{  ||  y .  (t)-  l  yV(t)  ||2} 
1  k=l 


0 


(4-4) 


The  functions  4>k(t)  are  assumed  to  be  such  that  {<}t  (t))k=1  are  complete  ortho¬ 
normal  sets  for  i=l , 2.  For  convenience  in  what  follows  we  require  that 


)!(t)  =  s. (t)  ,  0  <  t  <  T 

ri  i  —  — 


(4-5) 


The  y^  are  defined  by 


yk  =  /  y .  ( t)  <£k  (t)  dt 
i  „  1  1 


(4-6) 


and  are  clearly  Gaussian  random  variables.  Since  {<ft)  are  orthonormal  sets 
we  have  that 


y]  = 
1 1 


x 

f  s. (t) n , ( t) dt  4  w}:  H° 

0  1  1 

T  _ 

f  s.(t)[  s^(t)+n^(t)]dt  A  +wp 


1.  h1 


(4-7) 


and  for  k>2 


r  <|>*(t)n.  (t)dt  A  wk: 
'f  x  i  —  1 


k 

yi  = 


f  $k(t)  [^E..  si(t)+ni(t))dt  4  vr: 


k: 


(4-8) 


Furthermore, 


j=l,2 


(4-9) 


E{y!y*|H^}  =  0  ,  ,  i=l, 2  , 


and 


(4-10) 


for  all  l  and  k.  This  implies  that  only  the  y*  depend  upon  the  hypothesis  and 
SL  k 

that  the  y^  and  y2  are  independent.* 

Let  us  now  consider  the  problem  in  which,  instead  of  receiving  a  waveform 
y^(t),  the  i-th  agent  instead  receives  the  vector 


K 

*i 


fyi'yi' 


(4-11) 


where  the  y^  are  defined  in  Eqs.  4-7  and  4-8.  We  know  from  [1]  that  for  agent 
1  the  optimum  decision  law  is  given  by 


p(y,|H°)p°  0 

-  -  >  t 

P(yllH1)p1  1 


(4-12) 


where 


fcl  = 


AJ  +AJ  /  p{y2  iH^dy^ 
f.r(y^>t2 


aj3+aj4  f  p(y2lH0)dY2 


(4-13) 


Sir  (y2)  >t2 


Without  the  Gaussian  assumption  on  the  noise  we  only  have  that  the  y^  and  y2 
are  uncorrelated. 
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Because  the  are  statistically  independent*  and  because  only  y*  depends 
upon  the  hypothesis 


p(Z>»)p°  p<yllH  1  k^2  P(yl,P 
pl^["1)pl  p(y||H>)  l  plyV 

k=2  1 


(4-14a) 


It  0  0 

ptyjn  )p 

p(y* !h1)pJ 


(4-14b) 


Similarly  for  agent  2  we  have  that 


K  P(y^H°)p° 


(4-1 5a) 


=  £r(y2) 


(4-15b) 


Equation  4-13  thus  can  be  written  as 


K  » 


r  +AJ  f  p(y2 |hj )dy2  n  f  p(y2)dy 

2  —  oo 


k.  k 

2)dy2 


dr(y^)>t2  k=2  -® 

tl  ~  K  *  T 

AJ  +AJ  J  p(y* | H°)dy^  n  f  p(y2)dy 
ir(yl)>t2  k=2  -® 


(4-16a) 


Here  is  where  the  Gaussian  noise  assumption  is  used, 
uncorrelated  we  cannot  expand  p(y^|H^). 


If  the  y^  are  only 


AJj+AJ2  S  p(y^ |h! )dy* 

^r(yl)>t2 

AJ3+AJ4  f  p(yl|H°)dyl 

^r(yl)>t2 


(4-16b) 


Note  that  neither  t^  nor  S.r(y^)  =  ir(yj)  depend  on  K.  We  can  thus  let  K 
to  go  to  infinity  and  the  decision  laws  remain  unchanged.  The  solution  to  the 
waveform  observation  problem  is  thus  given  by 


0 

«r(yh  £  t 
1  1  1 


(4-17) 


where  tj  is  given  by  Eq.  4-16b  and  t2  is  given  by 


AJ5+AJ2  f  p(yj|H1)dyJ 
v.r  (yj)  >t 

t  =  \ - — - ,  (4-18) 

AJfi+AJ4  J  P ( y | | H  0 ) dy  j 

«.r(yj)>t1 


and  where 


T 

y]  =  f  s. (t)y. (t)dt  .  (4-19) 

1  0  1  1 

Because  we  have  assumed  Gaussian  statistics  for  the  observation  noise  we 
can  obtain  a  more  compact  expression  for  Hr(yj)  and  for  the  equations  defining 
the  thresholds.  Let  us  compute  the  mean  and  variance  of  y^  under  the 
hypotheses: 


T 

e{ y? | h  0 }  =  E{/ 

si ^ ni ^ ^ =  0 

0 


(4-20) 
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T  _  __ 

i;  {  y  ^  |  H  1  }  --  Y.{J"  sAt)[-^K  i  (t)  +iv  ( t)  ]dt}  = 


_  T  T 

E{ (y  ?-y 1 ) " (H1 j  =  E{  /"  f  s . (t) s. (t) n . (t) n . (i ) dtdt} 
i  i  1  j  j  i  i  i  i 

0  0 


T  T 

=  f  f  s .  (t) s . (t) N . ( t) 6 (t-T ) dtdt 

0  o  1  1  1 


9  ~  2 

st (t) N . (t)dt  A  N . 

li  “l 


If  we  rewrite  Eq.  4-17  as 

0 

Sn[ Ir (y!)  ]  <  In (t  )  =  t  . 

i  i  i  i 


then  the  decision  rules  become 


Vh 

!  Ei  °  P° 

y  +  -  >  t  -  in  (  ) 

2N2  i  P1 

N2 

l 

1 

or  equivalently 

T 

1 

/  s 

0 

. (t)y. <t)dt  <  T. 

11  1 

0 

where  the  thresholds  T  .  satisfy 

l 


T 


1 


Nj  (  AJ j  +AJ 2  erf[(T2-  y/e2)/N21  po  ) 

(  AJ3+AJ4  erf(T2/N2J  p1  ) 


(4-21) 


(4 -22a) 


(4-22b) 


(4 -22c ) 


(4-23) 


(4-24) 


(4-25) 


(4-26) 
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1 


(4-27) 


rp 


2 


n;  (  aj^+aj.,  ftfKTj-  ^'.'l  )/ni  1  j 

\K,  -  -  -*■-  in  J  ■  - - - - 

V E2  (  AJC+AJ^  erflW  J 


Note  that,  as  in  classical  detection  theory,  the  waveform  case  is  attacked 
by  determining  a  finite  set  of  sufficient  statistics  and  writing  the  decision 
law  in  terms  of  these  statistics.  In  the  case  just  considered  y!  is  a  scalar 
sufficient  statistic  for  agent  i  and  this  leads  to  the  test  of  y!  against  a 
threshold.  The  sufficient  statistic  computed  in  Eq.  4-19  can  also  be  found  as 
the  output  of  a  matched  filter  designed  for  the  i-th  signal.  Thus  the  optimal 
decision  law  can  be  interpreted  as  comparing  the  outputs  of  "local"  matched 
filters  against  thresholds  which  are  determined  "globally." 

As  in  Section  3,  the  equations  defining  the  thresholds  are  necessary  but 
not  sufficient  and  thus  if  multiple  solutions  exist,  the  associated  costs  must 
be  computed  and  compared  in  order  to  determine  a  globally  optimal  solution. 

Note  too  that  since  the  waveform  case  reduces  to  a  scalar  problem  if  the 
underlying  system  is  a  fusion  system  the  ROC  curves  computed  in  [1]  (or 
similar  ones)  can  be  used  to  analyze  the  tradeoff  between  probability  of 
detection  and  false  alarm. 

5.  GENERAL  GUASSIAN  WAVEFORM  OBSERVATIONS 

In  this  section  we  extend  the  results  of  the  previous  section  by  allowing 
the  observations  of  each  agent  to  be  a  known  deterministic  signal  corrupted 
by  an  arbitrary  zero-mean  Gaussian  process,*  where  the  signal  depends  upon  the 
hypothesis.  Thus  we  have  that  the  observations  are 

* 

The  assumption  of  zero  mean  is  not  restrictive  as  any  nonzero  mean  can  be 
incorporated  into  the  signal.  We  shall  require  that  the  noise  have  a  white 
comi>onent  so  as  to  avoid  the  unrealistic  possibility  of  perfect  detection. 
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(5-la) 


H1:  z.(t)  =  J e!  s ! ( t )  +  n.(t)  ,  T  <  t  <  Tc 

i  Vii  i  o  —  -  f 

H°:  z.(t)  =  »/e?  s°(t)  +  n.  (t)  ,  T  <  t  <  T  (5-lb) 

l  Vii  i  o  —  —i 


where 


Eln^ (t)n^ (t) }  AK^(t,t)  (5-2) 

and,  as  usual,  we  assume  that  n^(t)  and  n^tt)  are  independent. 

We  assume  that  the  signals  s9(t)  and  s^(t)  are  exactly  zero  outside  the 
interval  CKt<T.  We  allow  the  observation  period  to  be  different  from  [0,T] 
since  with  nonwhite  noise  an  extended  observation  period  can  allow  better 
performance. * 

Rather  than  work  with  z^(t)  as  given  by  Eq.  5-1  we  define  y^Ct)  as  a 
reversible  function  of  z^(t)  and  work  with  y^  (t) .  We  choose  y^(t)  to  make  the 
derivation  more  straightforward.  Since  y^(t)  is  obtained  from  z^(t)  by  a 
reversible  operation  working  with  y^(t)  yields  the  same  detection  performance 
as  working  with  z^Ct)  (2].  We  define 

y .  (t)  =  z.(t)  -  -v/E°  s?(t)  ,  T  <  t  <  T,  (5-3) 

i  i  »ii  o  —  —  r 


so  that 


H1:  yi(t)  =  si(t)  +  ni (t) 


T  <  t  <  T, 
o  —  —  f 


( 5-4 a) 


Consider  the  case  where  Si(t)  is  constant  on  [0,1]  and  zero  elsewhere  and 
ni(t)  is  constant  on  [-1,1].  Clearly  perfect  detection  is  possible  if 

v°- 
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11°:  y .  (t)  =  n.  (t)  ,  T  <  t  <  Tr 

1  1  o  —  —  f 


( li— 4  b ) 


where 


Ve.  s!  (t)  -  s? (t) 

,  v  *11  *11 

S  .  (  t)  - - 

VEi 


T  <  t  <  T* 
O  —  —  f 


(5-5) 


T  _  _ 

E.  =  r  [\/e}  sUt)  +  Ve?  s?(t)]2dt 
1  ^  *11  11 


(5-6) 


Clearly  we  have  that 


T 

f  s?(t)dt  =  1 
0  1 


(5-7) 


for  s^(t)  defined  by  Eq.  5-5. 

As  in  the  last  section,  to  solve  the  waveform  problem  we  consider  a 
sequence  of  detection  problems  formed  by  truncating  a  Karhunen-Loeve  (K-L) 
expansion.  To  avoid  the  unrealistic  possibility  of  perfect  detection  we  assume 
that  the  noises  n^(t)  have  white  components.  Thus,  formally,  we  can  write 

K^(t,r)  =  K^(t,i)  +  N^ftJStt-x)  .  (5-8) 

We  now  expand  the  observation  y^(t)  in  a  K-L  expansion 

K  .  . 

y.  (t)  =  l.i.m.  I  y .  ip .  (t)  ,  T  <  t  <  T  (5-9) 

1  ,,ii  o  —  —  f 

k=l 

where  the  <J>^(t)  satisfy  the  inteyral  equation 
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(5-10) 


xk 


V(t)  =  /  K^(t,uHk(u 

l  X  rr* 


>au  .  t  <t<T 


I£  tho  solutions  to  Eq.  5-10  do  not  lot.  a  coyote  ott„onot»l  sat  U.e.,  if 


KC(t,x)  is  not  iJOsitive 
i 


definite),  we  augment  it  to  make  it  complete. 


Under  we  have  that 


yk  -  sk  t  n) 
*  1  i  1 


(5-11) 


where 


sk  A  /  yj\  si(t)<)>k(t)dt 

X  rji 

o 


v  k 

nk  A  f  ni(t)<j)i(t)dt  . 

1  T 

o 


Under  H°  we  have  that 


k 
n . 
l 


Furthermore 


E{np  =  0 


E{(nk)2}  =  Xk  +  N2  A  Xk 


E(n2nk}  =  0 


J^k 
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(5-12) 


(5-13) 


(5-14) 

(5-15) 

(5-16) 

(5-17) 


and 


r  ,  l  —  l.  k  — k 
e{  <y j-y x )  (y2-y2) 


H1}  =  0 


Consider  the  problem  where  each  agent  receives  the  first  K  coo 
in  the  K-L  expansion  of  y^(t).  As  before  we  define 


K  i  k. 

*i  =  [yi . yi] 


The  decision  law  for  agent  1  is 


where 


*r(Y*)  £  t* 


„  ,  K, 

ir(y  ) 
~l 


K 

n  p(y, |h°) 

k=l 


K 

n 

k=l 


n  pfy^H1) 


AJ1+AJ2  KP*Y-2  lHl)d^-2 


<  = 


"£r  (y^)  >fc2 


AJ„+AJ,  /  r\  I  vr^  I  hO 


3-4,  r*  p° 

^r^Z2)>t2 


Equation  5-21  can  be  written  as 


(5-18) 

f  f ic ients 


(5-19) 


(5-20) 


(5-21) 


(5-22) 
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K 

I! 

k= 


..  .  K 

(y.i  >  = 


exp 


,  k  ‘ 

1  JV 

2  ,k 


K 

n 

k  = 


1  V27,xi 


exp 


k  k  2' 

i  (yrsi> 


(5-23) 


Canceling  common  terms  and  letting  K-*-®  we  have 


ta[ir(y,(t))] 


k  k  ,  k.2 

®  y .  s .  ,  ®  (s . ) 

=  -  Z  li-i  +  i-  Z  — X-~ 

k=l  A  k=l  A 


(5-24) 


k  k 

Using  the  definition  of  and  y^  we  can  rewrite  Eg.  5-24  as 


ln[lr(yi(t))J 


If  (  If  -  ^(t)^(u)  _  ) 

-J  {  J  y-(t)  z  - r -  Je  s  (u)du  dt 

T  /  T  1  k=l  AK  V 

n  '  o  1  I 


Def ining 


T  /  T 

4  /  /£ 

T  /  T 
o  '  o 


®  <t>*(t)  <£*(u)  ) 

(t)  l  - r -  s .  (u)du  ;  dt 

x-1  **  I 


(5-25) 


Qi(t,u) 


®  <f>k(t)<4(u) 

1 - iT — 

k=l  XK 


(5-26) 


and 


—  rf 

^(t)  =  -^E,.  tJ  Qi(t,u)si 


(u)  du 


(5-27) 
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we  can  rewrite  Eq.  5-25  as 


l  A  £n [ £r  (y\  (t) )  ] 


1 

=  -J  {yi(t)+  2  y/\  s.  (t))g.(t)dt  .  (5-28) 


The  decision  rule  for  agent  1  thus  becomes 


i  _ _  0 

-  J  (y.(t)-  —  Jex  Sj (t))g1 (t)dt  <  ln(tl 
T  ’  1 


)  =  T, 


(5-29) 


where 


t  =  lim  t 
K-w> 


(5-30) 


K  . 


and  tj  is  given  by  Eq.  5-22.  If  we  define 


„K  .  r,  ,  K„ 
l ^  =  Hnlir^J] 


(5-31) 


then  Eq.  5-22  can  be  rewritten  as 


AJj+AJj  •/* 

in(t2> 


AJ3+AJ4  y'  pU^l^dt*  P 
Inftp 


(5-32) 


The  limit  of  t.  can  now  be  obtained 

l 


AJj+AJ2  f  p  ( £-2  I  H1 )  dA, 

T2 _ ‘ 

CO 

AJ3+AJ4  f  p(H2  I  H°)dSL: 


(5-33) 


To  determine  we  need  the  statistics  of  i But  i 2  is  a  linear  func¬ 
tion  of  y2(t)  so  it  is  a  Gaussian  random  variable.  We  have 


Vh  ;f 
2 


E{  |  H0}  -  -  /  s2(t)g2(t)dt  Am2 


(5-34) 


E{f  JH1}  =  - 


s2(t)g2(t)dt  =  -m2 


(5-35) 


and 


E{  (£2-£2)2|h1} 


T  /  T 

r  )  r 


S  /  g  (t)K2(t,u)g2 (u)du j  dt 

T  (  To  ) 


(5-36) 


o  '  o 


Recalling  the  definition  of  g2 (t)  from  Eq.  5-27  we  have 


E{  (£2~£2) 2  j  H1} 


rf  \  rf  rf  ) 

•^e7  J  v  J  g2(t)  J  K2  (t,u)Q2  (u,v)  s2  (v)dvdu  dt  . 

2  T  /  T  T  1  -,-7> 

o  '  o  o  '  (5-37) 


It  cam  be  shown  [2]  that  £h(u,v),  as  defined  by  Eq.  5-26  satisfies 


f  K  (t,u)Q(u,v)du  =  6(t-v) 


(5-38) 
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so  that  Eq.  5-37  becomes 


r{ («2-e2) 2 


_  -I 

H1}  =  yjE2  f  g2(t)s2(t)dt  =  2m2 


(5-39) 


The  threshold  t .  thus  satisfy 

i 


x  =  in 


AJ  +AJ  [1-erf  (  (x ]  p1 
AJ3+AJ  [1-erf  ( (T2-m2)/V2m^)  ]  p° 


(5-40) 


AJ 


t2=  in 


,+AJ2  [1-erf  ((x1+m1)/^m^)]  p1 


AJ  +AJ.  (1-erf  (  (t.  -m  )/'\/2m~) )  p° 
6  4  11*1 


(5-41) 


The  decision  rules  are  thus  given  by 


/*£  l  .  -t 

J  yi(t)gi(t)dt  <  —  Vh  /  Si(t)9i(t)  ” 


t . 
l 


(5-42) 


where  g^(t)  are  determined  from  Eqs.  5-27  and  5-38,  the  solve  Eqs.  5-40 
and  5-41  and  y^(t)  is  determined  from  Eq.  5-3. 

As  before  the  equations  defining  the  are  necessary  but  not  sufficient. 
Thus  to  determine  a  globally  optimal  solution,  the  costs  corresponding  to  all 
solutions  to  Eqs.  5-40  and  5-41  must  be  computed  and  compared. 


6.  SUMMARY 


In  this  paper  we  have  extended  the  results  of  Tenney  and  Sandell  [1]  to 
the  case  in  which  each  agent  makes  waveform  observations  in  Gaussian  noise. 
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In  these  eases  the  optimal  decision  laws  are  the  same  as  in  the  centralized 
case  (i.e.,  we  perform  certain  linear  operations  on  the  signal  and  compare  the 
resultant  scalar  to  a  threshold),  however,  as  in  [1]  the  agents  thresholds 
satisfy  coupled  nonlinear  equations.  We  have  given  explicit  formulae  for 
determining  these  thresholds  for  both  the  case  in  which  the  noise  is  purely 
white  and  in  which  the  noise  is  colored  {with  a  white  component) . 

In  ongoing  research  we  are  considering  problems  in  which  the  observations 
of  the  different  agents  need  not  be  conditionally  independent.  For  these  cases 
we  are  able  to  use  many  of  the  techniques  of  this  paper,  though  we  find  that 
globally  optimal  results  cannot  usually  be  determined.  The  results  of  this 
paper  motivate  a  suboptimal  decentralized  detection  scheme  in  which  signal 
processing  is  only  locally  optimal  but  the  thresholds  are  determined  globally. 
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SECTION  1 


INTRODUCTION 

In  this  paper  we  extend  the  distributed  detection  results  derived  by 
Lauer  and  Sandell  [1]  and  Tenney  and  Sandell  [2]  for  uncorrelated  sensor 
noise  to  the  case  of  noise  which  is  correlated  between  the  distributed 
sensors.  Determining  the  optimal  decentralized  detection  law  for  the 
correlated  noise  problem  requires  the  solution  of  sets  of  functional 
equations.  Since  these  equations  are  not  analytically  tractable  and  since 
they  are  not  amenable  to  numerical  solution  techniques,  we  consider  a  sub- 
optimal  detection  policy  termed  the  Decentralized  Likelihood  Rato  Test 
(DLRT)  and  motived  by  the  uncorrelated  noise  results. 

In  section  2  we  introduce  the  correlated  noise  problem  and  briefly 
describe  physical  situations  which  give  rise  to  it.  In  section  3  we  show 
that  determining  the  optimal  distributed  detection  policy  requires  solving 
coupled  sets  of  functional  equations  and  we  introduce  the  class  of  sub- 
optimal  detection  policies  with  which  we  will  be  concerned  for  the  remainder 
of  the  paper.  In  section  4  we  give  some  numerical  results  illustrating 
the  behavior  and  performance  of  the  suboptimal  laws.  In  section  5  we 
briefly  consider  whether  the  loss  in  performance  of  the  decentralized  as 
compared  to  the  centralized  detection  law  associated  with  the  example  of 
section  4  is  intrinsic  in  the  constraint  to  decentralized  signal  processing 
or  is  due  to  the  fact  that  only  a  suboptimal  law  is  being  considered. 


Finally,  in  section  6  we  discuss  various  extensions  of  the  results  of  this 
paper  that  are  currently  under  investigation. 
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SECTION  2 


PROBLEM  FORMULATION  AND  MOTIVATION 


As  in  [1]  we  assume  that  there  are  two  distributed  sensors,  indexed  by 
i  =  1,  2,  and  two  hypotheses  to  be  tested  based  on  the  sensor  observations, 

indexed  by  j  =  0,  1.  The  observations  under  the  two  hypotheses  are  assumed 

* 

to  be  generated  by 

H  :  y;.(t)  =  ^s.U)  +  n.(t)  T0ltlTf  (2-la) 

H°:  yi(t)  =  n. (t)  T0£t£Tf.  (2-lb) 


Here  we  assume  that  s^(t)  is  a  known  signal  with  unit  energy  which  is  zero 

outside  the  interval  [0,  T]  where  T  <0<T<T,.  The  n.  (t)  are  assumed  to  be 

o—  —  f  1 

zero-mean  Gaussian  processes  where 


:{n.(t)nk(T)}- 


K^(t,T) 


(2-2) 


and  we  assume  (to  avoid  the  possibility  of  singular  detection) 


K .  n  ( t , t )  =  KC(t,r)  +  N.f(t-x) 

li  l  l 


(2-3) 


with  jt  o.  Note  that,  unlike  [1]  we  do  not  assume  that  the  noise  processes 

*  Q 

Recall  from  [1]  that  assuming  no  signal  is  present  under  H  entails  no 
loss  of  generality. 
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are  uncorrelated,  i.e.  we  allow  K.n(t,t)  to  be  non  zero  for  i  /  k. 

lk  1 

As  in  [1]  we  assume  that  the  objective  is  to  minimize  the  expected 
global  cost ,  i.e.. 


min  E  [ J  (u  , u,  , H)  ]  (2-4) 

Uj,u2  J  2 

where  only  decentralized  decision  rules  of  the  form 

' 

0  ,  H°  is  declared  to  have  occured 

ui  =  '  1 

1  ,  H  is  declared  to  have  occured 

in  which  is  a  function  of  y^(t)  alone  are  allowed.  Recall  from  tl]  that 
this  formulation  of  the  cost  allows  us  to  consider  both  cases  in  which 
decisions  are  made  strictly  by  local  agents  and  cases  in  which  tentative 
local  decisions  are  made  which  are  sent  to  a  global  decision  maker  for  a 
final  decision. 

The  assumption  that  the  sensor  noise  is  correlated  arises  realistically 
in  many  detection  problems.  For  example,  in  passive  detection  (e.g., 
passive  sonar  or  passive  electromagnetic  signal  detection)  noise  is  likely 
to  be  correlated  between  nearby  sensors  (e.g.  ambient  sea  or  atmospheric 
noise) .  Even  in  active  detection  correlated  noise  may  be  a  realistic 
assumption.  For  example,  the  radar  returns  from  a  fluctuating  target  are 
likely  to  be  correlated  if  the  sensors  are  located  close  together. 
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SECTION  3 


SUBOPTIMAL  DECISION  POLICY 

Let  us  attack  the  problem  of  section  2  using  the  technique  and 
notation  of  ([1],  sections  4  and  5).  This  simply  involves  expanding  the 
observations  in  a  Karhunen-Loeve  (K-L)  expansion  [3]  and  considering  the 
problems  formed  by  truncating  the  infinite  series  of  K-L  coefficients. 

Recall  that  we  expand  y^(t)  via 


y.(t)  =  l.i.m.  Z  yk<)>k  (t) 
K  ®  k=l  1 


T  <t<T 
o - f 


(3-1) 


where  the  <^(t)  satisfy 


r  T 

k$k(t)  =  /  fK°(t,u)<jik(u)du  ,  T  <t<T, 

ll  .r  1  1  0 - 1 


(3-2) 


1 

Under  H  we  have 


k  k  k 

y .  =  s . +n . 

l  li 


(3-3) 


where 


sk  =  fT  f  VElSl(t)$k(t)dt 

o 

k  A  f 
n  =  J , 


T  f  ni(t)^k(t)dt, 

o 


(3-4) 

(3-5) 


while  under  H  we  have  that 


k  k 

y  .  =  n  . 
i  i 


(3-6) 
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As  in  [1] 


E{nk}  =  0  (3-7) 

1 

k  2  r, 1,  2 

E { (n  )  }  =  A  +N.  (3-8) 

1  11 

E{n£nk}  =0  1  ^  k  (3-9) 

l  l 


however,  unlike  [1] ,  the  K-L  coefficients  are  generally  correlated.  That  is 

-T_  rT. 


:  {(yj-EWjlH3})  (yk-E{y2|H3})  |h3}  =  /  f  /  (t)K^  (t]T)  $k  (i)dtdx  (3-10a) 


A  ?k 
=  c 


(3-10b) 


which  is  not  generally  zero. 

From  [1]  the  optimal  decision  law  based  on  the  first  K  coefficients 
of  the  K-L  expansion  is  given  by  the  solution  of  the  following  two  equations 


AJ  j  +AJ 2  f  P(Z.- >diL2K 

4h=° 


(3-11) 


AJ3+AJ4  f  p(Zk  y^H°)dZ2 

Ki-  „ 

Z2)u?=° 


^2^  \ 


AJ5+AJ2  /  p(^ 

ill|Ul  =  0 

AJe+AJ4  /  p(^i  iL2'H°)d^i 

V° 


(3-12) 
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Note  that  the  decision  law  for  each  sunsor  is  required  to  determine 
the  region  of  integration  for  the  right  hand  side  (r.h.s.)  of  equations 
3-11  and  3-12.  Unlike  the  uncorrelated  noise  case  the  structure  of  the 
optimal  distribution  decision  law  is  not  of  the  form 

Sr. (yK)  §  tK  (3-13) 

1^-1  <  1 

K  K 

since  the  r.h.s  of  equations  3-11  and  3-12  depend  on  and  .  Thus  we 
cannot  convert  the  functional  equations  3-11  and  3-12  into  equivelent 
algebraic  equations  for  t^ . 

No  analytic  solution  to  these  equations  has  been  determined  and 
numerical  techniques  do  not  seem  to  be  computationally  tractable.  We  are 
thus  motivated  to  examine  suboptimal  decision  laws  for  the  problem  of 
distributed  detection  with  correlated  sensor  noise. 

The  approach  we  take  is  to  note  that  equations  3-11  and  3-12  can  be 
written  as 


ir.(y^)  §  t^(^c)  (3-14) 

K  K  K 

and  that  by  replacing  t^(jr^)  with  a  non  data  dependent  threshold  t^,  the 

functional  equations  reduce  to  algebraic  equations  of  the  form  considered 

in  (1]  and  [2] .  This  is  equivalent  to  assuming  locally  optimized  signal 

processing  (i.e.,  signal  processing  that  would  be  optimal  if  only  one 

sensor  at  a  time  were  considered)  but  with  a  globally  optimized  threshold. 

This  approach  has  the  further  advantage  of  being  simple  to  implement 

the  limit  as  K  ■'  »  of  the  likelihood  ratio  i^(y^)  is  a  scalar  computed  by 
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integrating  (t)  against  a  deterministic  function  g^(t).  The  optimal 
solution  need  not  necessarily  be  a  finite  dimensional  test  and  thus  consid¬ 
erations  of  implementability  might  motivate  examination  of  this  decentralized 
likelihood  ratio  test  (DLRT)  even  if  equations  3-11  and  3-12  could  be 
solved. 

The  limit  of  in  [  (y^)  ]  as  K  ►  <*>  is  given  by 


t.  =  fn [£r . (y . ) ]  =  -  f  f/y.  (t)-  —  Ve^s . (t))  g  (t) dt  (3-15) 

i  li  \  1  5ii/i 


where 


/T 

fQi (t,u)si (u) du 


(3-16) 


and  Q.  satisfies 
1 


r 


fKi^(t,u)Qi(u,v)du  =  6(t-v) 


(3-17) 


The  detection  laws  we  shall  consider  thus  are  of  the  form 


l . 

1 


T  . 
1 


(3-18) 


To  determine  the  optimal  we  note  that  the  are  Gaussian,  and 
determine  the  mean,  variance  and  correlation  of  the  under  each  hypothesis. 
We  compute 


E{£ 


|H°  )  = 


& 

2 


f 


^s  .  ( t) g  .  (t) dt  =  +m . , 
11  1 


(3-19) 


8 


r 


E{  2-i  I  H 1  }  =  -  1 L  J  fsi  (t)gi  (t)dt  =  -nu , 


(3-20) 


ip 

j|(£i-E{Jli|Hj}  )2|Hjj-=VEi  J  fg^  (t)  s..  (t)dt  =  2nu , 


Ej^-EUi  |Hj  })  (£2-EU2  |Hj  }  |H j|  =  /f91(t) 


/JTfK 22  (t,u)g2  (u)du 


(3-21) 


dt  =  c 


(3-22) 


The  cost  associated  with  any  pair  of ' thresholds  Tj  and  is  given 
(to  within  an  constant  independent  of  T  ^  by 


/OO  /-00 

p(«.j  |H1)d£1p(H2)-AJ  J  pOlj  H°)d£.1p(H°) 


/CO  -OO  y~  -W 

J  p(£1,!l2|H1)d£2d£1p(H1)-AJ4  J  J  p  (£  ^  |  H°)  d£  2d  £  p  (H° )  . 


T1  T2 


T1  T2 


(3-23) 


One  half  of  a  necessary  condition  for  optimality  of  the  T ^  can  be 
obtained  by  differentiating  3-23  with  respect  to  T,  and  setting  the  result 


to  zero.  This  yields 


-  OO  r  CO 

-AJ  jP(tj |H1)+AJ3p(Tj |h°) -AJ2  J  p(Ti,£2|H1)de2  +  AJ u  J  p(tl(£2|H°)d£2  =  0 


(3-24) 


Using  equations  3-19  through  3-22  we  can  rewrite  3-24  as 


We  assume  p(H°)  =  p(HJ)  =  1/2  for  ease  in  notation. 
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(3-25) 


r 


T  =  fn 


fAJj+AJ^l-erf  (  (x2+in2-p  (Tj+nij)  )/  /2m2  (1-p2)  )^| 


AJ 


3+/'J4(l-erf  ( (T2-m2~p  \/m2/m~  ( t  j  -m  j  > )  /  V 2m2  (l-p?)  ]) 


Similar  computations  yield  the  second  half  of  the  necessary  condition: 


t2  =  tn  ( 


fAJ5+AJ2^l-erf  (  (t  j+mj-p  Vrr^/n^  (r2+m2>)  /  ’/5m^(l-p2) )  j 


[hj^+AJ^^l-erf  [  {t  j-mj-p  Vn^/n^  (T2~m2))  /  / 2m  j  (1-p2  )  J 


.  (3-26) 


Equations  3-25  and  3-26  are  necessary  conditions  for  the  optimality 
of  Tj  and  t2-  In  general  these  equations  have  multiple  solutions,  in 
which  case  one  must  evaluate  the  cost  associated  with  each  solution  to 
determine  the  best  detection  law  in  this  class. 
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SECTION  4 


EXAMPLE 

In  this  section  we  consider  an  example  involving  a  scalar  observation 
with  correlated  noise.  First  we  introduce  the  observation  model  and  rewrite 
the  necessary  conditions,  then  in  subsections  4.1  and  4.2  we  consider  two 
different  global  cost  functions. 

Assume  that  the  observations  are  given  by 

H1:  yi(t)  =  V^E~  sin(27Tt)+ni(t)  0<t<l  (4-la) 

H°:  yi(t)  =  ni(t)  0<t<l  (4-lb) 


where  n^(t)  is  zero-mean  unit  variance  white  Gaussian  noise  with 


E{nj  (t)n2  (t)  }  =  p<5(t— r). 


(4-2) 


We  assume  p°  =  p1  =  1/2  and  note  that,  from  3-15, 


=  -/  y.( t)  n/^. 


sin (2nt)dt+E^/2 . 


(4-3) 


The  detection  law  can  thus  be  rewritten  as 

,T 


,  f x  I  A  ■  i 

y  ;  =  J2  /  y .  (t)  sin  (2nt)dt  >  T.  = - -  - - t  .  . 

1  v  ./  1  <1  „  /  1 

0  2  s/E . 


(4-4) 


11 


Defining 


and  noting  that 


m . 

i 


E./2, 

l 


we  have  from  equations  3-25  and  3-26 


(4-5) 


(4-6) 


4.1  BAYESIAN  FORMULATION 

We  assume  that  the  thresholds  T.  are  to  be  selected  so  as  to  minimize 

i 

the  expected  Bayes  cost  defined  by  equation  2-4  where 


0 

if 

u 

1 

= 

u  = 
2 

H 

J  = 

1 

if 

U1 

¥ 

U2 

(4-9) 

k 

L 

if 

U1 

= 

U2  " 

H 

This  type  of  cost  criterion  may  arise  if  a  decisionmaker  is  associated 
with  each  sensor  and  must  act  on  the  basis  of  that  sensor's  data  alone.  For 
example,  if  the  sensors  are  radars  and  the  decisions  determine  whether  or 
not  missiles  are  fired  at  enemy  targets,  then  having  two  missed  detections 
may  be  much  more  serious  than  having  one  missed  detection.  This  situation 
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would  be  modeled  by  choosing  k  >  2,  so  that  a  double  error  is  more  than 


twice  as  costly  as  two  single  errors. 

For  J  defined  by  4-9,  equations  4-7  and  4-8  become 


dl  1 

T  =  — - £n 

2  a . 

l 


1  +  (k-2 ) erf 


T2"a2"p(Trai) 


v/l-C 


(k-l)-(k-2)erf 


rVpTi7 


Wl-p2 


a2  1 


in 


1+  (k-2) erf 


T,-a,-p (T2-a 2) 


r 

L  Vl~V 


(k-1) - (k-2) erf 


rTi_2T2l 

-v4-d2  - 


and  we  note  that  the  "locally  optimal"  decision  laws  (Tj  =  aj/2,  T, 
satisfy  equations  4-10  and  4-11.  This  can  be  seen  by  noting  that 


In 


a7-p  a 


1+ (k  2 ) erf  , - , 

L  2  Vl-p  J 

=  £n 

1+  (k-2)  ^1-erf 

1-2  \/l-p2- 

r 

(k-1) - (k-2 ) erf 

ra2-pa  i  -| 

(k-1) - (k-2) erf 

ra  -pa  n 
\  2  \ 

-.A  J 

=  iln 


■a  -Pa, 


■(k-1)  -  (k-2)erf 

(k-1) - (k-2) erf 

ra2-pai  “j 

2  v/l-p2-' 

That  is  the  laws  which  would  be  optimal  for  each  sensor  in  isolatic 
respect  to  a  minimum  probability  of  error  criterion. 


(4-10) 


(4-11) 


=  a2/2) 


(4-12a) 


(4-12b) 


with 
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en(l)  =  0 


(4-1 2c) 


Equations  4-10  and  4-11  are  symmetric;  if  (Tj,  T,,)  is  a  solution, 
then  (aj-Tj,  a2~T9)  is  also  a  solution.  This  is  seen  by  noting  that  if 


then 


a  1 

Ti  =  r  "  17  *n 


1+  (k-2) erf 


-T2-a2-p (Tj-a  ) 


rT  ~PT. 


(k-1 )  - (k-2 ) erf 


(4-13a) 


a  1 

arTi  =  -  -  -  ^ 

2  al 


(k-l)-(k-2)erf  [T2-pT  /  \/l-p2] 


1-t- (k-2)erf  [T2-a2-p  (Tj -aj )  /  v/l-p^] 


(4- 1 3b) 


al  1 

(k-1) - (k-2) 

1-erf 

r'vV'Vt(l,i'i1 

2i)l' 

■ —  —  x.n 

2  &  ^ 

1+  (k-2 ) 

[l-erf t(a2-T2)-p(a1-T1)/  /l-pd 

1 

a  1 

_1_  _  _ 

2  a. 


fn 


1+ (k-2) erf 


r (a2  ^2^  a2  a  1  ^ 3 


\/l-p2 


(k-1 ) - (k-2 ) erf 


<a2-T2)-p (aj-Tj) 


-P 


(4-13 c) 


.  (4-13d) 


The  costs  associated  with  these  two  symmetric  solutions  are  identical 
and  thus,  if  a  solution  with  T^  ^  a ^/2  exists,  only  one  of  this  pair  need 
be  evaluated. 

Graphical  solution  of  equations  4-10  and  4-11  shows  that  there  are  at 
most  three  solutions  to  these  equations,  and  for  certain  values  of  k  and  p 
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there  is  only  one  solution  (the  "locally  optimal"  solution).  In  Figures 
4-1  and  4-3  we  plot  the  Bayes  cost  associated  with  the  decentralized 
likelihood  ratio  test  (DLRT)  and  with  the  "locally  optimal"  (LO)  solutions 
for  aj  =  1,  =  2  and  various  p  and  k.  In  Figures  4-2  and  4-4  we  plot  the 

associated  thresholds. 

Figure  4-1  is  a  plot  of  the  Bayes  cost  as  a  function  of  k  for  p  =  0 
and  p  =  .5  .  Note  that,  as  p  increases,  the  optimal  DLRT  solution  becomes 
much  better  than  the  LO  solution.  This  is  because  the  optimal  solution 
skews  the  thresholds  to  avoid  the  double  errors  which  are  more  common  for 
larger  p  and  more  costly  for  larger  k  (see  Figure  4-2). 

Note  that  for  the  LO  solution  the  cost  increases  as  an  affine 
function  of  k  since  the  probability  of  a  double  error  is  independent  of  k. 
The  optimal  DLRT  solution  never  exceeds  a  Bayes  cost  of  1  since  this  cost 
can  be  obtained  by  setting  the  thresholds  so  that  one  detector  always 
decides  0  while  the  other  always  decides  1. 

Figure  4-3  is  a  plot  of  the  Bayes  cost  as  a  function  of  D  for  k  =  5. 
Again  we  see  that  as  p  increases  the  optimal  DLRT  solution  becomes  much 
better  than  the  LO  solution.  This  occurs  because,  as  p  +  1,  the  probability 
of  a  double  error  (for  fixed  thresholds)  increases.  The  optimal  DLRT 
solution  skews  the  thresholds  (Figure  4-4)  to  decrease  the  probability  of 
a  double  error.  This  yields  a  27%  decrease  in  cost  over  the  LO  solution. 

These  results  indicate  that  in  some  cases  there  is  a  significant  gain 
to  be  had  by  using  the  optimal  decentralized  likelihood  ratio  test  rather 
than  a  naive  approach  which  ignores  the  correlation  between  sensors.  Since 
we  cannot  determine  the  globally  optimal  decision  rule,  it  is  not  possible 
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THRESHOLDS 


Figure  4-2.  Thresholds  as  a  Function  of  k  lor 
with  E.,=l,  E2=4  and  p=0  or  0.5. 


BAYES  COST 


Figure  4-3.  Bayes  Cost  as  a  Function  of  p  for  DLRT  and  LO  Laws 
with  £^=1,  an<^ 
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THRESHOLDS 


2.5  i - 


p(CORRELATION) 


Figure  4-4.  Thresholds  as  a  Function  of  p  for  DLRT  and  LO  Laws 
with  Ej=l,  E2=4  and  k=5. 
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to  determine  how  much  is  lost  by  using  the  decentralized  likelihood  ratio 
test  as  a  substitute.  We  discuss  this  issue  in  more  detail  in  section  5. 


4.2  FUSION  CENTER  DESIGN 

In  this  subsection  we  assume  that  each  sensor  sends  its  local 
decision  to  a  fusion  center  where  a  global  decision  u  is  made.  We 

assume  that  the  fusion  center  law  is  defined  as  u  =  1  if  and  only  if 
Uj  =  u  =  1.  We  display  the  performance  of  the  fusion  center  via  receiver 
operating  characteristic  (ROC)  curves  which  plot  probability  of  detection 
versus  probability  of  false  alarm.  In  addition  to  plotting  the  performance 
of  the  optimal  DLRT  we  also  plot  the  performance  of  the  optimal  centralized 
detection  law.  This  allows  us  to  determine  how  the  performance  of  the 
detection  system  is  degraded  by  requiring  that  only  local  decisions  rather 
than  sensor  data  be  transmitted  to  the  fusion  center. 

The  ROC  curve  can  be  obtained  by  varying  the  ratio  of  the  cost  of  a 
false  alarm  to  the  cost  of  a  missed  detection.  If  we  let  the  false  alarm 
cost  be  unity  and  the  missed  detection  cost  be  a  then  the  necessary 
conditions  for  optimality  become 


1-erf 

.(vv»<VSh 

l/v/l-p2 

1-erf 

(Tj-pT2)/  vA-p2 

a  1 

n 

V  j-j 

1-erf 

(T2-a2-p(T]-a1))/  \/l-p2j 

2  a2 

1-erf 

(T?-pTj  )  /  v/l-p2 

(4-14) 


(4-15) 


Figures  4-5 


through  4-8  are  plots  of  the  performance  of  the  optimal 
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-  CENTRALIZED 


Figure  4- 


DLRT 


0.5 


.  ROC  Curves  for  Centralized  and  DLRT 
Laws  with  Ej=l,  E2=l  and  p=0.25. 


CENTRALIZED 


centralized  test  and  that  of  the  DLRT  for  the  case  where  the  sensors  are 
identical,  =  a  =  1.  We  see  that  as  p  increases  the  centralized  and 
DLRT  results  become  more  and  more  similar.  Figure  4-9  shows  that  as  p 
increases  the  performance  degrades. 

This  occurs  for  the  centralized  problem  because  as  p  increases  the 
information  available  for  decision  making  effectively  decreases  from  2 
independent  observations  with  p  =  0  to  1  with  p  =  1.  As  p  increases  in  the 
DLRT  case,  each  sensor  has  a  better  and  better  indication  of  what  the 
other  observation  was,  and  thus  the  centralized  solution  can  be  more 
closely  approximated  by  the  decentralized  solution. 

Note  however  that  the  performance  of  the  DLRT  while  more  closely 
approaching  that  of  the  centralized  test  degrades  as  p  -*  1 .  This  can  be 
understood  by  noting  that  if  p  is  the  probability  of  a  local  decision 

2 

being  wrong  then  the  probability  of  a  double  error  is  approximately  p 
when  p  =  0  but  is  p  when  p  =  1.  Since  the  fusion  center  always  makes  an 
incorrect  decision  when  both  local  decisions  are  wrong,  the  performance 
degrades  as  p  +  1. 

The  phenomenon  of  the  DLRT  and  centralized  results  growing  closer 
together  as  p  increases  is  not  universal.  Figures  4-10  through  4-14 
illustrate  the  behavior  of  these  two  decision  laws  for  the  case  of 
asymmetric  sensors,  aj  =  1  and  =  2.  In  Figure  4-10  we  see  that  for  the 
DLRT  as  p  +  1  the  performance  degrades.  The  reason  is  exactly  as  in  the 
case  of  a;  =  a?  =  1.  For  the  centralized  case  however  the  performance 
becomes  perfect  as  p  -*■  1.  This  occurs  {Figs.  4-11  through  4-14)  because 
by  differencing  the  sensor  observations  one  has 
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(4-16a) 


H2:  Ay  ( t )  =  y  ;  (t )  -y  (t)  =  (  \/  2  ~  1 )  sin  (2i!t)+nj  (t)  -n„  (t) 

H° :  Ay  (t)  =  yj(t)-y^(t)  =  nj(t)-n„(t)  .  (4 - 10b) 

/ —  1  o  . 

As  p  +  1,  Ay-*(  v  2-1)  sin  < 2 tt t )  if  H  is  true  and  Ay  =  0  if  H  is  true, 

thus  perfect  detection  is  possible. 

These  graphs  illustrate  that  the  price  involved  in  using  a  DLRT  law 
is  strongly  dependent  on  the  problem  being  considered.  Similarly,  the 
benefit  in  reduction  of  communications  requirements  is  highly  problem 
dependent.  It  is  thus  the  case  that  detailed  analysis  is  required  to 
determine  whether  a  DLRT  or  a  centralized  detection  law  should  be 
implemented  in  a  given  situation.  An  interesting  questions  remains  however: 
is  the  poor  performance  of  the  DLRT  in  this  second  problem  due  to  the 
decentralization  constraint  or  due  to  the  fact  that  the  DLRT  need  not  be  the 
optimal  decentralized  law?  We  briefly  address  this  question  in  the  next 
section. 
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SECTION  5 


ANALYSIS 


For  the  case  considered  in  the  previous  section,  the  structure  of 
the  optimal  distributed  decision  law  is  known.  More  generally,  if 
Sj  (t)  =  s2 (t)  and  the  noise  corrupting  the  observations  is  white  Gaussian 
noise,  the  optimal  distributed  decision  law  structure  is  known.  Consider, 


H1:  y.  (t)  =  v/E.s(t)+n.  (t) 

1  1  l 

H° :  yi(t)  =  ni(t) 


0<t<T 


(5-la) 


(5-lb) 


where  n, (t)  is  zero-mean  unit  spectral  height  white  Gaussian  noise  with 


E{n  j (t)n,  (t)  }  =p5  (t-T) . 


(5-2) 


As  usual  we  expand  the  signal  into  K-L  coefficients  where  we  now 


choose  the  orthonormal  functions  <Jr  (t)  so  that 


<t*(t)  =  <f>2(t)  =  4>k(t)  ,  0<t<T 


(5-3) 


and 


4' 1  (t) 


S (t)  ,  0< t<T  . 


(5-4) 
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We  have 
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The  DLKT  for  both  problems  in  the  previous  section  tests  a  scalar 
against  a  threshold.  If  is  greater  than  the  threshold,  then  HJ  is 
declared,  otherwise  H°  is  declared.  The  DLRT  is  thus  optimal  if  the 
optimal  decentralized  test  is  such  that  there  is  only  one  region  in  which 
H1  is  declared.  This  need  not,  however,  be  the  case  in  general. 

Consider  Figure  5-1  wherein  the  DLRT  law  for  a  Bayes  problem  with 
p  =  1  and  large  k  are  illustrated.  The  laws  are  given  by  a  tick  mark  on 
a  line  where  the  threshold  T^  lies.  Note  that,  since  p  =  1,  there  are  3 
regions  of  interest.  In  A,  both  local  decisions  are  u^  =  0,  in  B,  Uj  =  0 
and  u,  =  1  and  in  C  both  u.  =  1. 

2  l 


u  =  0  u=0  T  u  =  1 

2  2  2  2 


Figure  5-1.  Decision  Laws  for  Bayes  Problem  with  p=l. 

A  decision  law  with  exactly  identical  performance  is  illustrated  in 
Figure  5-2.  Here  in  A  both  u.  =0,  in  C  both  u.  =  1  and  in  B  one  u.  =  0 

l  i  l 

and  the  other  u^  =  1.  This  shows  that  the  optimal  decentralized  law  may 
have  multiple  thresholds. 


We  have  derived  necessary  conditions  for  the  optimality  of  local 
decision  laws  using  up  to  3  thresholds.  Only  for  problems  with  ] p ]  >  .9 
have  we  found  local  decision  laws  which  satisfy  the  necessary  conditions 
and  have  more  than  one  threshold.  For  all  of  these  cases  the  performance 
of  the  multiple  threshold  law  was  inferior  to  that  of  the  optimal  DLRT. 

While  this  does  not  prove  that  the  DLRT  is  optimal  for  this  example 
it  does  indicate  that  the  poor  performance  of  the  DLRT  for  the  case  where 
a1  =  1  and  a2  =  2  is  probably  due  to  the  requirement  of  a  decentralized 
rule  rather  than  the  restriction  of  our  attention  to  the  particular  case 
of  DLRT  laws. 


SECTION  6 


SUMMARY  AND  EXTENSIONS 

In  this  paper  we  have  extended  the  results  of  Lauer  and  Sandell  [1] 
to  the  case  of  correlated  observation  noise.  As  in  [2]  this  leads  to  a 
pair  of  functional  equations  which  must  be  solved  to  determine  the  optimal 
decentralized  decision  rule.  Since  these  equations  are  not  readily  solved, 
we  introduce  a  suboptimal  law,  the  decentralized  likelihood  ratio  test. 

Several  examples  were  considered,  contrasting  the  DLRT  to  naive 
decentralized  laws  and  to  optimal  centralized  laws.  These  examples  indicate 
the  advantages  of  using  the  optimal  DLRT  over  a  naive  "locally  optimal”  rule 
and  also  indicated  that  the  DLRT  may  perform  almost  as  well  or  much  worse 
than  a  centralized  law  depending  on  the  given  situation.  This  indicates 
that  judgement  must  be  exercised  when  deciding  when  a  decentralized 
decision  rule  should  be  used. 

Finally,  we  presented  arguments  to  the  effect  that,  while  the  DLRT 
may  not  be  optimal  even  for  problems  which  reduce  to  scalar  tests,  the 
limitations  indicated  by  the  examples  of  section  4  are  grounded  in  the 
requirement  of  decentralization  rather  than  being  due  t<_  consideration 
of  suboptimal  decentralized  decision  laws. 

In  ongoing  research  we  are  considering  the  problem  of  detecting 
an  unknown  signal  in  noise  using  distributed  sensors.  The  approach  we 
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take  is  similar  to  the  one  herein  —  we  consider  suboptimal  laws  based  on 


testing  the  local  log  likelihood  ratio  against  globally  optimized  thresholds. 
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SECTION  1 


INTRODUCTION 

In  this  paper,  we  extend  the  methodology  developed  by  Lauer  and  Sandell 
[1]  for  distributed  detection  of  known  signals  in  the  presence  of  correlated 
noise  to  the  case  of  unknown  signals  in  white  noise.  As  in  [1]  the  optimal 
detection  policy  requires  the  solution  of  coupled  functional  equations  and 
thus  is  not  practical.  We  therefore  consider  a  suboptimal  detection  policy 
based  on  assuming  that  the  structure  of  the  local  detection  laws  is  a  likeli¬ 
hood  ratio  test  (LRT)  and  then  jointly  optimizing  the  thresholds  of  the  local 
decision  laws. 

Because  the  likelihood  ratio  (LR)  is  not  a  linear  function  of  the  obser¬ 
vations,  it  is  difficult  to  determine  the  p.d.f.  of  the  LR  for  the  purpose  of 
threshold  optimization.  We  therefore  compute  the  first  two  moments  of  the  LR 
and  use  these  to  determine  the  local  thresholds  and  to  evaluate  the  perfor¬ 
mance  of  the  distributed  detection  strategy. 

The  structure  of  this  paper  is  as  follows:  In  Section  2,  we  formulate 
the  problem  of  distributed  detection  of  an  unknown  signal  in  noise  as  well  as 
the  suboptimal  policy  we  will  analyze.  In  Section  3,  we  determine  the  mean 
and  covariance  of  the  LR  under  each  hypothesis.  In  Section  4,  we  consider  a 
scalar  example  which  illustrates  some  of  the  tradeoffs  to  be  considered  when 
implementing  a  distributed  detection  policy.  Finally,  in  Section  5,  we  sum¬ 
marize  the  results  and  discuss  extensions  we  are  investigating. 
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SECTION  2 


PROBLEM  FORMULATION 

Let  us  consider  the  problem  of  detecting  a  sample  function  from  a  Gaussian 
random  process  in  the  presence  of  additive  white  Gaussian  noise  based  on  mea¬ 
surements  by  two  sensors.  As  in  [ 1 J  —  [ 3 J  we  assume  that  it  is  not  desirable  to 
transmit  the  received  waveforms  to  a  central  location  for  optimal  processing. 

Thus  a  local  decision  u  must  be  made  at  each  sensor  and  we  assume  that  the 

i 

decisions  are  to  be  made  so  as  to  minimize  the  expected  value  of  a  global  cost 
which  depends  upon  the  u  and  the  true  hypothesis. 

For  this  problem  we  assume  the  i^  sensor’s  observation  under  the  two 
hypotheses  is  given  by: 

H1:  dy  (t)  =  s  (t)dt  +  dv  (t)  (KtCT  (2-la) 

i  i  i 

H° :  dy  (t)  =  dv  (t)  0<t<T  (2-lb) 

1  i 

where  dv  (t)  are  independent  zero-mean  Brownian  motion  processes  with 

E{v  (t)v  (s)}  =  min(t.s).  The  signals  s  (t)  are  zero-mean  and  have  known 
i  i  i 

covariances  given  by 


E { s  (t)  s  ( t) }  A  Ks  (t,T)  CKt,x<T 

i  i  1J 


(2-2) 


2 


We  assume  that,  based  on  y  (t),  u  is  chosen  so  that 

i  i 

0  indicates  H®  selected 
1  Indicates  H1  selected 


(2-3) 


and  that  the  u  are  to  be  chosen  so  as  to  minimize  a  global  cost  E{j(Uj ,u2>H) } , 

^  • 

where  J(u^,u2>H)  is  the  cost  associated  with  local  decision  and  u2  when  H 
is  true. 

From  arguments  similar  to  those  in  ( 2 ] — [ 5 1  the  optimal  distributed  policy 
has  the  following  structure:* 


£i(yi}  <  w 
0 


(2-4) 


where  the  f  (•)  are  the  solution  to  two  coupled  functional  equations  and  £*(y^) 
is  the  log  likelihood  ratio.  From  [5]  we  have  that 


T  ~  i  T  - 

£*(y  )  =  /  s  (t)  dy  (t)  -  /  s2(t)dt  (2-3) 

i  i  0  i  i  2  o  i 


where  the  first  integral  is  an  Ito  integral  and 

s^(t)  =  E{s  (t)|y^(r),  CKict,  H1} 


(2-6) 


1 

*The  notation  l  >  indicates  that  u=l  if  £> t,  u=0  if  £<t  and  u=0  or  1  if  £=t. 
0 
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The  equations  for  f  (•)  are  not  readily  solved  so  we  consider  Instead  the 

i 

suboptlmal  policy  given  by 


*i 


<  ti 


(2-7) 


where  we  define 


*i(yi)  A  /  ri(t)  dyi(t)  -  -  r2(t)dt 
"  0  2  1 


and  r  (t)  is  some  causal  linear  function  of  y^(t): 


t 

ri(t)  =  /  hi(t,T)  dyi(t) 

0 


(2-8) 


(2-9) 


The  definition  of  l  reduces  to  Eq.  2-5  when  r  (t)=s  (t)  but  allows  us  also 
i  i  i 

to  consider  signal  estimates  which  are  more  readily  computed  than  s^(t). 

Equation  2-8  yields  £  as  a  quadratic  form  on  the  observations  y^(t)  and 

thus  l  is  not  a  Gaussian  random  variable.  For  the  problems  considered  in 
i 

Section  A  accurate  results  can  be  obtained  by  assuming  is  approximately 

Gaussian*  and  thus  the  l  can  be  characterized  by  computing  the  first  two 

i 

moments  of  l  and  the  cross  correlation  between  £,  and 

i  1  2 

The  global  cost  associated  with  thresholds  t1  and  t is  given  by 


*For  the  cases  we  consider  in  Section  4,  the  Gaussian  assumption  leads  to 
results  which  agree  for  the  centralized  case  with  those  in  [41. 
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J-  J  |  /  /  p(«  ,t Jill)  ■u2atlJO,i,HJ) 

j-o  I  t,  t2 


t  J  OO 

+  /  /  p(ei,it2|HJ)d«2<UiJ(0,l,Hj) 

-00  t 


t2 


+  J  /  p(£1,£2)HJ)dJt2dilJ(l  ,0,Hi) 


C1  "* 


C1  tZ 


+  /'  /  p(£1,fc2|HJ)d)t2dt1J(0,0,Hj)  j  pJ 

—  OO  — OO  | 


(2-10) 


This  can  be  rewritten  as 


t\  tZ 


J  =  AJ0  +  AJt  /  p(*1|H1)dt1+AJ2  /  J  p(t1,*2|Hl)d£2di1 


AJ. 


ti  C1  tZ 

j  PU  |H0)dJl  • -AJ  /  /  p(i1,£2|H0)dt2d*1 

n  *  *  — OO  — OO 


where 


t2  t2 

+  AJ5  /  pU2|Hl)d*2-AJ6  /  p(£2|H°)d£ 


(2-11) 


AJQ  =  J(l,l,H°)p°-J(l,l,H1)p1 


(2-12a) 


AJ  =  lJ(0,l,H1)-J(l,l,H1)]p1 


(2-12b) 


AJ2  -  [J(0,0,H1)+J(l,l,H1)-J(l,0,H1)-J(0,l,H1)]p1  (2-12c) 
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AJ3  =  Ud  ,1  ,H°)-J(0,1  ,H°)]p° 


(2-12d) 


AJ^  =  (J(l ,0,H°)+J(0,1 ,H°)-J(0,0,H°)-J(1 ,1 ,H°)]p°  (2-12e) 


aj5  = 


( 2  —  1 2  f  ) 


and 


AJ6  =  [J(l ,1 ,H°)-J(1 ,0,H°)]p°  . 


(2-12g) 


Differentiating  Eq.  2-11  with  respect  to  t^  and  setting  it  to  zero  yields 
one  half  of  the  necessary  condition  for  optimality  of  the  thresholds: 


AJX  p(t1|Hl)+AJ2  /  p(ti,i2JH1)di2=AJ3  pCtjH^+AJ^  /  p(t  ,l2|H°)dt2 

— oo  —oo 

(2-13) 


Differentiating  Eq.  2-11  with  respect  to  t2  and  setting  it  to  zero  yields 


Aj5  p(t2|Hl)+AJ2  /  p(£i,t2)H1)dii  =  AJ6  p(t2|H°)+AJi<  /  P( ^ , t2 | H°)d£ j 


(2-14) 


Under  the  Gaussian  assumption  we  have  that 


P(£1,£2|H°) 


2v° 


ur"!>2 


1 


(Vm2)2 

1  2v° 

e  (2-15) 


v2ttv® 


/  2irv° 
2 


*Since  the  observations  are  independent  under  H® ,  £j  and  £ ^  are  uncorrelated. 
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and 


pUj , a2  Ih1  ) 


1 

- r 

1  2vjvl(l-p2) 

2*-y^  jv^(l-p2) 


(2-16a) 


where 


r  =  [(tl-m1x)2v^-2pyjv][v1z  ( l 


mJ  A_  E 1  |  H3  } 

mJ  A  E{U  -mJ)2|Hj  } 
i  “  1  i  i  ' 


P  =  cVv^H*  (2-19) 


and 


c1  AE(U1-bi|)U2-ij‘)|h>]  (2-20) 


1-m|)(£2-ml)+(A2-ml)2v|)  ( 2- 16b) 


(2-17) 


j=0,l  i=l,2 


(2-18) 


Using  Eq.  2-15  through  2-20  we  can  rewrite  Eqs.  2-13  and  2-14  as 


(t^J)2  (trm°)2 


2v} 


2v<? 


In 


AJ ,+AJ „  erf 


(t2-ml-p(v^/v1])1'/2(t1-m11) ) 


1 

\ 

fv^d-p)  J  j 

AJ.+AJ,  erf 

3  4 

(t2-m°)/vr 

i 

(2-21) 
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r 


(v^)2  (v^)2 

2vl  2v° 


These  equations  are  necessary  conditions  for  optimality  and  thus  if  multiple 
solutions  exist  the  corresponding  costs  must  be  computed  to  determine  the 
optimal  thresholds.  To  solve  these  equations,  however,  we  need  nJ ,  vJ  and  p. 
These  are  computed  in  the  next  section. 
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SECTION  3 


MOMENT  COMPUTATION 


Recall  that 


T  i  T 

Z  A  j  r  (t)dy  (t)  -  /  r2(t)dt  (3-1) 

i  0  i  i  20  i 

where 


Hi; 

dy^(t)  =  s^(t)dt  +  dv^(t) 

(3-2) 

H°: 

dy  (t)  =  dv  (t)  , 

i  1 

(3-3) 

and  r^(t)  is  a  linear  causal  function  of  yi(t). 

We  denote  by  E^{*}  ,  j=0,l  the  expectation  operator  assuming  the  model 

of  dyj(t)  given  by  H°  and  H1  respectively. 

We  have 


m° 

i 


T  i  T 

/  E  {r  ( t )dv  (t)}  -  /  E  {r2(t)}dt 

0  0  i  i  2  o  0  t 


E  (r2( t) }dt 
0  i 


(3-4) 
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T  1  T 

m1  A  E.  { A  }  -  /  E  {r  (t)s  (t)dt+r  (t)dv  (t)}  -  -  /  E  {r2(t)}dt 

i  -  o  1  i  i  i  i  2  o  1  1 


T  i  T 

»  /  E  {r  (t)s  (t)  }dt - /  E  { r 2( t) }dt  . 

0  1  i  i  2  o  1  i 

(3-5) 


The  second  moment  under  H°  is  given  by 


v°  A  E  {(£  -m0)2} 
i  “  0  i  i 


T  i  T  i  T 

/  r  (t)dy  (t)  -  /  r2(t)dt  +  -  /  E  {r2(t)}dt 

O1  1  2  o  i  2  o  u  i 


2 


T  i  T  T 

-  I  Vr;<t)}dt  +7  /  / 

0  1  4  0  0 


E0{rJ(t)r2(r)}  -  Eo{r2(t)} 


Eq { r2( t) }dtdr 


(3-6) 


Using  Gaussian  moment  factoring  [6]  we  have  that 


E0{r2(t)r2(r)}  =  E0{r2(t)}  E0{r2(x)}  +  2E{r  (t)r  (t)}5 


(3-7) 


So  v°  is  given  by 


vo 

i 


[E0{r1<t)r1(T>}]2dtdT 


(3-8) 


The  second  moment  under  H1  is  given  by  (again  using  moment  factoring) 
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I 


v1  A  E, 
i  “  1 


T  1  1  I 

/  r  (t)s  (t)-E  {r  (t)s  (t)}  -  r2(t)  +  -  E  jr2(t)}dt  ' 

0  i  i  1  1  i  2  i  2  J  i 

+  /  E,{r2(t)}dt 

0  1  i 


-  /  E  {r2(t)}dt  +  /  /  E  {r  (t)r  (t)}  • 

0  1  i  q  o  A  i  i 

[e  {s  (t)s  (t)  -  E  {s  (t)r  (t)}  -  E  {r  (t)s  (t)}  +  -  E  {r  (t)r  (t)}] 
1  i  i  1  i  1  1  i  i  2  1  i  1 


+  E  {r  (t)s  (t)}  E  {s  (t)r  (r)}dtdT 
1  i  i  1  i  i 


(3-9) 


Finally  we  have,  using  similar  arguments, 

cI  A  E1{(*1-ml1)(*2-m2)} 

-  J  /T  E1{rl(t)r2(T)}[E1{si(t)s2(T)}  -  E;  { r  t  (t)s2(  t)  }  - 

+  -  Ej { r  j (t ) r 2( t) }  ]  +  Ej{r j(t)s2(t) }  E x  (s l (t )r2( x) }dtdr 


(3-10) 


These  quantities  can  be  computed  once  h  (t,x)  is  specified  in  Eq.  2-9. 
We  shall  do  so  for  a  simple  example  in  the  next  section. 
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SECTION  4 


EXAMPLE 

In  this  section  we  consider  an  example  in  which  the  unknown  signal  is  a 
sample  path  from  a  stationary  Gauss-Markov  process  and  in  which  the  filter 
gains  K  (t)  of  the  Kalman  filter  that  can  be  used  to  compute  s  (t)  are  chosen 
as  the  steady  state  values  of  the  optimal  gains.  The  observations  processes 
of  concern  under  the  two  hypotheses  are 


H°:  dy  (t)  =  dv  (t) 
i  i 

(4-1) 

H1:  dy  (t)  =  c  x(t)dt  +  dv  (t) 
i  i  i 

(4-2) 

with 

dx(t)  =  -ax(t)dt  +  \/  2adw( t) 

(4-3) 

where  v  (t)  and 
i 

w(t)  are  independent  zero-mean  Brownian  motion 

processes  with 

E{v  (t)v  (s ) }  = 
i  i 

min(t,s)  and  E{w(t)w(s)}  =  min(t,s). 

The  r^(t) 

are  given  by 

r  (t)  -  c  x  (t) 
i  i  i 

(4-4) 

where 
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(4-5) 


dx  (t)  »  -ax  (t)dt  +  k  (dy  (t)-c  x  (t)dt) 
i  i  i  i  i  i 


The  signal  is  assumed  to  be  in  steady  state  so 


K®  (t,x)  =  c2  e~alt-Tl 
ii  i 


(4-6) 


K®2(t,T)  =  0^2  e-a  I t-T  I 


(4-7) 


The  filter  gains  k  are  the  steady  state  Kalman  gains: 


k  =  -a[l  -  / 1+c2  1/c 
i  i  i 


(4-8) 


We  shall  also  assume  that  the  observation  time  T  is  long  in  comparison  to  the 
inverse  bandwidth  of  the  signal  so  that  the  signals  r  (t)  are  in  steady  state 
for  most  of  the  interval  (0, T] .  This  implies  that,  to  a  good  approximation, 
we  can  assume  that  the  r^(t)  are  stationary.  Thus,  for  t>x 


E1{x(t)x(x)}  =  e-3^  T) 


(4-9) 


E  {x(t)x  (x)}  «  A  e~a(t-T) 
1  i  J  i 


(4-10) 


E  (x  (t)x(x)}  -  A  e  1  +  e 

1  i  i 


~n, (t-T)  -a(t-t)  -a, (t-x) 


(4-11) 


E  {x  ( t ) x  <  x)  }  -  A  e-3^  T) 
1  i  i  1  i 


(4-12) 
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E, jx  (t)x  (t)}  -Be 
1 1  t  2 


+  V® 


E0^XI(t)X2(T)^ 


a  Ai  -a.(t-x) 

-  e  1 


A 

i 


_ 2 

-t-  (-1  +  / l+2c2/a  ) 

2c2  i 

i 


a  =  a  v/ l+2c2/ a  , 
i  i 


A i( a2~a)+A2( otj  a) 


oil+a2 


We  can  thus  rewrite  Eqs.  3-4  through  3-10  as: 


2 

ciAiaT 


2 

c  .  A .  T 
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2  4  2  2  r 

;  aA  T  c.a  A 


I  -2 


V1 

i 


c2A  T  + 
i  1 


4  2 

ci(2VAi> 


2a 


T  -  -  (l-e-2aT) 
2a  v 


(4-21) 


c2c2 


1"2  j  2a 


1  ,  -2alTx 

T - (l-e  ) 

2aj 


1  ~2a2T 

T - (l-e  ) 

2a2  L  2a2 


-  r  t  -  - 

2a  L  2a 


(1 


_*-2aT' 


(4-22) 


whe  re 


1  „  1  „ 
-BA ,  +  B  +  -  B2  +  A, A  -  A.  -  BA„  +  -  A2 
1  2  12  2  2  2  2 


(4-23) 


1  „  1  „ 

-BA  +  B  +  -  B2  +  A, A  -  A  -  BA,  +  -  A2  , 
2  ■)  12  1  1  o  1  ’ 


(4-24) 


and 


1  ,  1  . 

E  =  A  +  A  -  -  A2  -  -  A2  .  (4-25) 

1  2  2  1  2  2 

In  the  figures  that  follow  we  have  selected  c  »c  so  that  the  sensors  are 

identical.  In  the  cases  we  examine  the  Gaussian  approximation  is  accurate 

except  for  the  tails  of  the  distributions.  This  Implies  that  we  cannot  get 

accurate  results  for  cases  in  which  P  is  constrained  to  be  small  (<.01  for 

F 

example).  An  approximat ion  which  is  valid  in  these  cases  has  been  developed 
and  will  be  reported  on  in  [8!  . 
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Figure  4-1  plots  the  probability  of  miss,  P  ,  as  a  function  of  signal 

M 

energy,  E,  and  time-bandwidth  product,  A= aT/2,  when  the  false  alarm  prob- 

billty,  P  ,  Is  fixed  equal  to  0.1.  Three  curves  are  given  on  this  plot.  That 
F 

labeled  "two  sensors  (centralized)"  corresponds  to  the  case  in  which  both 
yj(t)  and  y2(t)  are  available  at  the  fusion  center  and  are  used  in  making  an 
optimal  decision.  That  labeled  "one  sensor”  corresponds  to  assuming  only 
y^(t)  is  available  for  decisionmaking.  Finally,  that  labeled  "two  sensors 
(distributed)"  corresponds  to  the  performance  obtained  by  the  optimal  DLRT 
law.  In  all  of  these  cases  the  same  signal  energy  per  sensor  is  assumed. 

The  curve  for  "two  sensors  (centralized)"  is  horizontal  indicating  P 

M 

does  not  vary  with  A.  This  was  achieved  by  adjusting  the  energy  per  sensor 

E  as  a  function  of  A.  Note  that,  as  A  increases  from  10  to  10s,  the  energy 

required  to  maintain  a  constant  P  increases  from  10  to  606.6. 

M 

This  can  be  explained  as  follows.  For  a  fixed  observation  time  T, 
increases  in  A  correspond  to  Increases  in  signal  bandwidth  a.  As  the  signal 
bandwidth  increases  so  too  does  the  Kalman  filter  bandwidths  associated  with 
the  computation  of  s  (t).  Since  the  noise  is  assumed  to  be  white,  the  noise 
energy  in  s^(t)  is  proportional  to  the  Kalman  filter  bandwidth  and  thus,  as 
A  Increases,  the  signal  energy-to-noise  energy  in  the  signal  bandwidth 
decreases.  The  signal-to-noise  ratio  needs  to  be  constant  to  obtain  a  con¬ 
stant  P  and  thus  the  energy  required  increases  with  A. 

M 

For  a  fixed  bandwidth,  Increases  in  A  correspond  to  increases  in  the 
observation  time  T.  As  T  increases  the  noise  energy  in  the  signal  bandwidth 
increases  and  thus,  for  fixed  signal  energy,  the  signal-to-noise  ratio 
decreases.  Thus  as  A  increases,  the  energy  per  sensor  must  be  Increased  if 

constant  P  is  to  be  obtained. 

M 


16 


If  A  Is  decreased  below  10  then  other  effects  enter  and  eventually  domi¬ 
nate  the  computation  of  energy  required  to  attain  a  given  P  .  For  fixed  T 

M 

as  a  A  decreases  the  observations  y^(t)  becomes  more  strongly  correlated 

(l.e.,  y  (0)  and  y  (t)  are  more  strongly  correlated).  Thus  for  A  small 

enough,  less  information  is  available  for  decisionmaking  and  the  energy 

required  to  attain  a  fixed  P  increases.  This  effect  occurs,  however,  in  a 

M 

region  of  A  and  E  in  which  the  Gaussian  assumption  on  i  fails  and  thus  is 
not  illustrated  in  Fig.  4-1. 

The  curve  labled  "one  sensor",  in  this  scalar  problem,  can  be  generated 
by  the  same  computations  as  for  "two  sensors  (centralized)”  except  that  the 
energy  available  for  decisionmaking  is  reduced  by  half.  Note  that  P 

M 

increases  with  bandwidth,  despite  the  increase  in  energy,  indicating  an 

increased  sensitivity  of  P  with  respect  to  energy  as  bandwidth  Increases. 

M 

The  optimal  DLRT  performance,  labeled  "two  sensors  (distributed)," 
degrades  with  increasing  A.  The  best  DLRT  performance  thus  occurs,  with 
respect  to  the  centralized  two  sensor  case,  for  small  A.  The  one  sensor  case 
is  also  best  for  small  A  and  thus  the  best  DLRT  performance,  with  respect  to 
the  one  sensor  case,  occurs  for  large  A. 

The  requirement  of  using  a  distributed  law  effectively  reduces  the 
energy  available  for  decisionmaking.  We  have  determined  the  energy  required 
by  a  single  sensor  to  perform  as  well  as  the  DLRT  law  and  plotted  the  result 
in  Fig.  4-2.  The  curve  labled  "two  sensors  (distributed)”  is  simply  a  plot 
of  the  energy  per  sensor  versus  A  as  given  by  the  two  horizontal  axes  of 
Fig.  4-1.  The  curve  labeled  "one  sensor"  is  the  energy  required  by  a  single 
sensor  to  perform  as  well  as  the  optimal  DLRT  law.  The  top  curve  plots  the 
ratio  of  the  lower  two  curves. 
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We  see  that  the  "energy  loss"  entailed  by  using  DLRT  laws  is  not  fixed: 
at  A»10  two  DLRT  sensor  are  equivalent  to  about  1.12  centralized  sensors 
whereas  at  A=105  two  DLRT  sensors  are  equivalent  to  about  1.25  centralized 
sensors.  In  part,  the  effective  energy  loss  Is  not  fixed  since  the  correla¬ 
tion  p  between  and  decreases  with  increasing  A.  This  implies  that  for 
smaller  A  less  Information  is  available  to  the  fusion  center  and  poorer  per¬ 
formance  results. 
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SECTION  5 


CONCLUSIONS 

We  have  introduced  a  class  of  suboptimal  distributed  decision  laws  for 
the  problem  of  detecting  an  unknown  signal  in  noise  which  we  denoted  DLRT 
laws.  Using  a  Gaussian  approximation  we  were  able  to  determine  the  perfor¬ 
mance  of  these  laws  for  a  simple  scalar  example.  For  the  problem  considered 
an  optimal  DLRT  law  with  two  sensors  was  roughly  equivalent  to  1.25  central¬ 
ized  sensors,  thus  indicating  a  substantial  penalty  exists  for  using  dis¬ 
tributed  detection  laws  and  the  potentially  high  payoff  for  allowing  sensors 
to  communicate. 

We  are  currently  investigating  the  case  in  which  the  sensors  are  not  the 
same.  For  the  problem  considered  in  Section  4,  the  optimal  DLRT  thresholds 
are  identical  to  those  which  would  be  used  if  each  likelihood  ratio  test  were 
optimized  individually  (a  locally  optimal  DLRT).  This  occurs  because  the 
sensors  are  identical  and  is  not  the  case  when  the  sensors  are  different. 

The  optimal  DLRT  thus  performs  better  than  the  locally  optimal  DLRT  when  the 
sensors  are  different.  It  is  interesting  to  characterize  the  difference  in 
performance  between  these  two  types  of  laws  since  the  difference  is  effec¬ 
tively  free.  That  is,  the  improved  performance  of  the  optimal  DLRT  does  not 
require  more  communication  or  different  hardware  -  only  the  thresholds  are 
different. 
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We  are  also  developing  approximations  to  P  and  P  which  are  better  than 

M  F 

those  resulting  from  the  Gaussian  assumption  of  Section  2.  These  bounds  are 
based  on  those  developed  In  (4)  and  [7];  however  significant  modifications  are 
required  to  handle  distributed  decisionmaking. 
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